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CROSS-REFERENCE TO RELATED APPLICATIONS 

This application is a continuation-in-part of United 
States patent application serial no. 09/740,587 filed on 
December 18, 2000, which is a continuation of United States 
provisional patent application serial no. 60/172,980 filed on 
December 20, 1999, the disclosures of which are hereby 
incorporated by reference herein. 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

This invention relates to user interfaces and, in 
particular, to a pushbutton user interface that enables a 
user to preview the effect of activating a pushbutton before 
the pushbutton is actually activated. 

2. Related Art 

Pushbuttons provide binary control. Often, it is 
desirable to know what effect activating a pushbutton (i.e., 
actuating the pushbutton in a manner that produces the 
functionality associated with the pushbutton) will have 
before the pushbutton is activated. If the function of the 
pushbutton is constant, such as power on/off, the result of 
activating the pushbutton can often be known beforehand. 
However, if the function of the pushbutton can vary (such as 
is the case with a set of pushbuttons used to select pre- 
assigned radio stations), the result of activating the 
pushbutton may not be known with confidence beforehand. In 
such cases, it can be desirable to know what effect 
activating a pushbutton will have (e.g., which radio station 
a pushbutton will select) before committing to the 



activation. In particular, in a pushbutton user interface 
including multiple pushbuttons, it can be desirable to know 
what effect activating a particular pushbutton will have 
before the pushbutton is activated. 
5 Graphical icons formed on, or attached to, pushbuttons 

have been used to explain the behavior of pushbuttons on 
devices such as remote control units. However, graphical 
icons can be confusing and non-intuitive, particularly when 
used to explain specialized functions. 
10 A "mouse rollover" is a technique that has been used 

within the software user interface of a computer to explain 
the behavior of components of a graphical user interface of a 
computer. A mouse rollover occurs when a cursor or pointer 
is moved over a graphical icon or designated "hot spot" on 
%B 15 the screen of a computer's display device. Text 



corresponding to the icon or hot spot (which typically 
sj identifies the function or content* represented by the icon or 

hot spot) appears automatically; the mouse (or other user 
input device) doesn't have to be clicked (or otherwise 
Q 20 activated) for the text to appear. The mouse rollover 

technique is used in numerous computer programs, such as, for 
example, Adobe Photoshop. In Photoshop, for instance, a menu 
bar is included for the selection of various drawing and 
design tools. A graphical icon represents each tool. A 
25 picture of a paintbrush, for example, represents the 

paintbrush tool. Textual explanations for each tool appear 
on-screen as a pointer is moved over the corresponding 
graphical icon. Selecting (e.g., clicking a mouse or 
activating another input device) the graphical icon launches 
30 the tool. 
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SUMMARY OF THE INVENTION 

According to the invention, a pushbutton user interface 
enables a user to preview the effect of activating a 
pushbutton of the interface before the pushbutton is 
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activated. By providing a pushbutton with such preview 
capability, there is less need to attempt to explain 
pushbutton functionality through other means (which may be 
confusing and non-intuitive), such as use of a graphical 
5 icon, as has previously been done. Pushbutton user 

interfaces incorporating preview capability in accordance 
with the invention can be less confusing to use than previous 
pushbutton user interfaces and can therefore enable the 
creation of simpler and more understandable interfaces for 
10 use in remote control units and other complex control 
devices . 

In one embodiment of the invention, a pushbutton user 
interface enables a user to preview the effect of activating 
ig a pushbutton of the pushbutton user interface by sensing an 

*3 15 input (preview input) to the pushbutton that does not produce 
}fk an activation of the pushbutton and displaying, in response 

to the sensed input, a preview indicating the effect of 
activating the pushbutton. The preview input can be sensed 
using, for example, a force-sensitive resistor, potentiometer 
20 or strain gauge. The preview display can include, for 
example, a visual display, an audio display, a haptic 
display, or a combination of two or three such displays. The 
pushbutton user interface can be implemented so that the 
preview input and an activation input (i.e., an input that 
25 produces an activation of the pushbutton) are sensed as a 
result of an input to the pushbutton along the same axis or 
along different (e.g., orthogonal) axes. 

The principles of the invention can also be embodied in 
user interface apparatus other than a pushbutton user 
30 interface. For example, the principles of the invention can 
be implemented in user interface apparatus in which input is 
provided via mechanical apparatus, such as a doorknob, a 
toggle switch or a rotary switch. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of a pushbutton user interface 
apparatus according to the invention. 

FIG. 2 is a flow chart of a method, according to the 
5 invention, of operation of a pushbutton user interface 
apparatus according to the invention. 

DETAILED DESCRIPTION OF THE INVENTION 

According to the invention, a pushbutton user interface 
enables a user to preview the effect of activating a 
10 pushbutton of the interface before the pushbutton is 

activated. (The invention can be particularly advantageously 
implemented in a pushbutton user interface including multiple 

C3 

.p pushbuttons so that functionality preview capability is 

\Q provided for multiple pushbuttons.) By providing a 
u 

fp 15 pushbutton with such preview capability, there is less need 
Sj to attempt to explain pushbutton functionality through other 
^5 means (which may be confusing and non-intuitive), such as use 
I** of a graphical icon, as has previously been done. 
Q Additionally, the Invention can advantageously be implemented 

f y 20 so that the explanation of the functionality of a pushbutton 
Vj is closely tied to the actual experience of using the 
H pushbutton. A pushbutton user interface incorporating 

i-Ji. 

preview capability in accordance with the invention can be 
less confusing to use than previous pushbutton user 

25 interfaces and can therefore enable the creation of simpler 
and more understandable interfaces for use in remote control 
units and other complex control devices. A pushbutton user 
interface according to the invention can advantageously 
enable preview of currently unused functionality of a device 

30 without interrupting ongoing use of functionality of that 
device (e.g., as described further below, a pushbutton user 
interface according to the invention can be used, while 
viewing one television channel, to display one or more other 
television channels as small picture-in-pictures within the 
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display of the currently viewed television channel with 
relatively little disruption to the television channel being 
watched) . The invention can be used in, for example, 
consumer electronics products, cell phones, cable television 
5 products, MP3 players, remote control devices, and 
professional video and audio equipment . 

FIG. 1 is a block diagram of a pushbutton user 
interface apparatus 100 according to the invention. The 
pushbutton user interface apparatus 100 includes one or more 
10 pushbutton mechanisms 101, one or more input sensors 102, one 
or more processing devices 103, one or more preview 
displays 104 and activation apparatus 105, each of which are 
described in more detail below. The communication shown in 
FIG. 1 between components of the apparatus 100, including the 
15 directionality of that communication, is merely illustrative; 
it is to be understood that the invention contemplates any 



eg 

%j communication among the components of the apparatus 100, as 

can readily be understood by those skilled in the art, that 
enables the functionality of the apparatus 100, as described 
p 20 herein, to be achieved. 

Each pushbutton mechanism 101 of the pushbutton user 
interface apparatus 100 enables a user to effect 



w functionality associated with the pushbutton mechanism 101. 

For example, a pushbutton mechanism 101 can be used to select 

25 one of a multiplicity of radio stations or television 

channels (or, more, generally, one of a multiplicity of any 
type of audio, visual or audiovisual channel). A pushbutton 
mechanism 101 can also be used to select a link displayed 
within a Web page. A pushbutton mechanism 101 can also be 

30 used to activate a function provided in a desktop computer 
application or to continuously control the degree of a 
function provided in a desktop computer application. A 
pushbutton mechanism 101 can also be used to open or unlatch 
a door. 
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A pushbutton mechanism 101 can be implemented using 
conventional apparatus known to those skilled in the art. 
For example, a pushbutton mechanism 101 can be implemented 
using a pushbutton cap that is compliantly supported with a 
5 spring so that pressing on the pushbutton cap causes the 
pushbutton cap to be displaced from a rest position at which 
the pushbutton cap is held by the spring when the pushbutton 
cap is not being pressed. Herein, such a pushbutton 
mechanism is sometimes referred to as a "displacement-type 
10 pushbutton mechanism." In a displacement-type pushbutton 

mechanism, pressing on the pushbutton cap can be sensed using 
a displacement sensor, force sensor or touch sensor. A 
pushbutton mechanism 101 can also be implemented using a 
pushbutton cap that is supported so that pressing on the 
1 5 pushbutton cap causes the pushbutton cap to be displaced 
negligibly or not at all. Herein, such a pushbutton 
\j mechanism is sometimes referred to as a "touch-sensitive 
W pushbutton mechanism." In a touch-sensitive pushbutton 
'J* mechanism, pressing on the pushbutton cap can be sensed using 

Q 20 a force sensor or touch sensor (e.g., a temperature sensor 

that can be used to sense touch or a light sensor that can be 
used to infer touch from blockage of light in the vicinity of 
the light sensor. 

In accordance with the invention, each pushbutton 
25 mechanism 101 can enable a user to provide an activation 

input and a preview input. An "activation input" is an input 
to a pushbutton mechanism 101 that produces an activation of 
the pushbutton mechanism 101, i.e., that produces the 
functionality associated with the pushbutton mechanism 101. 
30 (Examples of such functionality are discussed above.) A 
"preview input" is an input to a pushbutton mechanism 101 
that does not produce an activation of the pushbutton 
mechanism 101 and that produces a display (preview display) 
indicating the effect of activating the pushbutton 
35 mechanism 101. 
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A pushbutton user interface apparatus 100 can be 
implemented so that both the preview input and the activation 
input are effected along the same axis and in the same 
direction. Such a pushbutton user interface apparatus 100 
5 can be implemented, for example, so that an activation input 
is produced by depressing (displacing) a displacement-type 
pushbutton mechanism 101 more than a specified amount or 
applying greater than a specified force to a displacement- 
type or touch-sensitive pushbutton mechanism 101. A preview 
1 0 input can be produced in such a pushbutton user interface 

apparatus 100 by, for example, depressing a displacement-type 
pushbutton mechanism 101 less than a specified amount or by 
applying less than a specified force to a displacement-type 
Jg or touch-sensitive pushbutton mechanism 101. Such a 

Ml 15 pushbutton user interface apparatus 100 can, but need not 

u 

*q necessarily, further be implemented so that a preview input 

\j is only produced if a displacement-type pushbutton 



mechanism 101 is depressed by greater than a second specified 
amount or greater than a second specified force is applied to 

20 a displacement-type or touch-sensitive pushbutton 

mechanism 101 (the second specified amount or force being 
less than the first specified amount or force that defines an 
activation input). Further, such a pushbutton user interface 
apparatus 100 can be implemented so that when a preview input 

25 is produced, the content of a preview display that results 
from a preview input can vary in accordance with the amount 
by which the pushbutton mechanism 101 is depressed or the 
degree of force applied to the pushbutton mechanism 101. 
Implementing the pushbutton user interface apparatus 100 so 

30 that both the preview input and the activation input are 
effected along the same axis and in the same direction has 
the advantage that the pushbutton user interface 
apparatus 100 can typically be constructed more easily and 
cheaply than an implementation of the pushbutton user 

35 interface apparatus 100 in which the preview and activation 
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inputs are effected in different directions or along 
different axes. A pushbutton user interface apparatus 100 
implemented in this manner may also be easier to use, since 
both the activation and preview inputs are controlled in the 
5 same manner using the same apparatus. 

A pushbutton user interface apparatus 1 00 can 
alternatively be implemented so that the preview input and 
the activation input are effected in opposite directions 
along the same axis or along different axes. Such a 
10 pushbutton user interface apparatus 100 can be implemented, 
for example, so that an activation input is produced by 
pressing (displacing or applying a force to) a pushbutton 
mechanism 101 in a direction along a first axis and a preview 
input is produced by pressing (displacing or applying a force 



»p 15 to) the pushbutton mechanism 101 in a direction along a 



second, lateral axis (i.e., along an axis orthogonal to the 
axis along which the pushbutton mechanism 101 is pressed to 
CO produced the activation input), an input sensor 102 being 

"J* provided to sense displacement or force along the second 

13 20 axis. Alternatively, the pushbutton mechanism 101 can be 

i j 

? j implemented to include a touch sensor so that a preview input 

*j is produced when a predetermined surface (which can be the 

same surface that is pressed to produced an activation input 
or a different surface) of the pushbutton mechanism 101 is 
25 touched. Implementing the pushbutton mechanism 101 so that 
the preview and activation inputs are effected along 
different axes can be advantageous because such an 
implementation may make separate control of the preview and 
activation functionality easier, particularly since the 
30 relatively small range of displacement of many conventional 
pushbutton mechanisms may make such separate control 
difficult when both the preview and activation inputs are 
effected by depressing the pushbutton mechanism in the same 
direction by a particular amount that is specified to 
35 correspond to that type of input. 




9 



- 9 - 

Typically, the pushbutton user interface apparatus 100 
includes multiple pushbutton mechanisms 101. In general, the 
utility of the invention increases as the number of 
pushbutton mechanisms 101 of the pushbutton user interface 
5 apparatus 100 increases. This can be because, for example, 
the increasingly large number of input options may make it 
increasingly desirable to obtain an understanding of the 
input options available before committing to one. 
Additionally, even when a user has previously used the 
10 pushbutton user interface apparatus 100, as the number of 
pushbutton mechanisms 101 of the pushbutton user interface 
apparatus 100 increases, it becomes more difficult for a user 
to recall the function associated with each pushbutton 
mechanism 101. 

ip 15 Each input sensor 102 of the pushbutton user interface 

*~ apparatus 100 senses input by the user to one or more of the 

% 4 pushbutton mechanisms 101. An input sensor 102 can be 

W implemented by, for example, any device that can be connected 

to a pushbutton mechanism 101 so that the device exhibits a 
C3 20 change in physical properties in response to displacement of 
(a displacement sensor), force applied to (a force sensor), 
or touching of (a touch sensor), the pushbutton 
mechanism 101. For instance, an input sensor 102 can be 
implemented by a force-sensitive resistor, a potentiometer or 
25 a strain gauge mounted on the underside of a pushbutton cap. 
The pushbutton user interface apparatus 100 can be 
implemented so that one or more input sensors 102 (each input 
sensor 102 constituting separate apparatus) sense input to a 
single pushbutton mechanism 101, and it is anticipated that 
30 the invention will typically be implemented in this manner. 
(Multiple input sensors 102 may be used to sense input to a 
single pushbutton mechanism 101, for example, when the 
pushbutton user interface apparatus 100 is implemented so 
that preview and activation of the pushbutton mechanism 101 
35 are actuated by moving the pushbutton mechanism 101 in 
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different directions or along different axes, as discussed 
further above.) However, the pushbutton user interface 
apparatus 1 00 can also be implemented so that one input 
sensor 102 senses input to multiple pushbutton 
5 mechanisms 101. Such an implementation can be constructed in 
a manner similar to that used in a computer keyboard or other 
keyboard or keypad interface, in which a single apparatus can 
sense (discrete) input from multiple keys or input points. 
The processing device(s) 103 of the pushbutton user 
10 interface apparatus 100 evaluate data produced by the input 
sensor(s) 102 to determine the type of control that is 
intended to be effected by the user (i.e., to determine 
whether the user intends to activate the pushbutton 
Iq functionality or obtain a preview of that functionality, and, 
%B 15 in the latter case, perhaps determine the amount or degree of 

3 i 

fQ preview to provide) and perform any other processing 
% 4 functions that are necessary or desirable to implement the 
pushbutton user interface apparatus 100. A processing 
device 103 can be implemented using any conventional 
20 processing device that is appropriate for use in the 
pushbutton user interface apparatus 100 as particularly 
implemented (e.g., that is compatible with the other 
components of the pushbutton user interface apparatus 100, 
such as the input sensor (s) 102). Selection of such a 
25 processing device can be readily accomplished by those 

skilled in the art. Further, those skilled in the art can 
appreciate that there are a large variety of such processing 
devices . 

Each of the preview displays 104 of the pushbutton user 
30 interface apparatus 100 produces, in response to a preview 
input from the user, a display of a preview of the effect of 
activating a pushbutton mechanism 101. A preview display 104 
can appeal to any of the senses, i.e., a preview display 104 
can be a visual display, audio display, tactile display, 
35 olfactory display or taste display. Typically, the type(s) 
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of the preview display (s) 104 and/or the implementation ( s ) of 
the preview display (s) 104 depend on the nature of the 
functionality associated with the pushbutton 
mechanism(s) 101. For example, when the pushbutton user 
5 interface apparatus 100 is used to select a radio station (as 
described in more detail below), a preview display 104 can be 
a display of a radio station corresponding to a pushbutton 
mechanism 101, the volume of which varies in accordance with 
the degree of the preview input. Or, for example, when the 
10 pushbutton user interface apparatus 100 is used to select a 
television program (as also described in more detail below), 
a preview display 104 can be a display of a television 
station corresponding to a pushbutton mechanism 101, the size 
of the display varying in accordance with the degree of the 
\Q 15 preview input. 

The pushbutton user interface apparatus 100 can be 
Q implemented so that a preview input to a pushbutton 

CO mechanism 101 causes the production of one or multiple 

y preview displays 104. Moreover, when multiple preview 

C3 20 displays 104 are produced, the preview displays 104 can be of 
^ multiple types. For example, the preview displays 104 can 

Sj include a combination of two or three of a visual display, an 

audio display and a haptic display. Examples of audio and 
visual preview displays have been discussed above. A 
25 pushbutton user interface apparatus 100 can also be 

implemented to provide haptic feedback through one or more of 
the pushbutton mechanisms 101 to, for example, give a tactile 
or kinesthetic sensation that corresponds to the genre, 
station or other qualities of audio or video content that is 
30 available for selection by the pushbutton mechanism(s) 101. 
The information upon which the haptic display is based can be 
automatically extracted from the corresponding content or the 
information can be human annotations which are broadcast or 
stored with the content. 



The activation apparatus 1 05 of the pushbutton user 
interface apparatus 100 effects, in response to an activation 
input from the user, the functionality associated with the 
pushbutton mechanism(s) 101. The implementation of the 
activation apparatus 105 depends on the nature of the 
functionality associated with the pushbutton 
mechanism(s) 101. For example, when the pushbutton user 
interface apparatus 100 is used to select a radio or 
television station, the activation apparatus 105 is a radio 
or television, respectively. When the pushbutton user 
interface apparatus 100 is used to select a link within a Web 
page, the activation apparatus 105 is software and hardware 
that effects the display of the content associated with the 
selected link. 

FIG. 2 is a flow chart of a method 200, according to the 
invention, of operation of a pushbutton user interface 
apparatus according to the invention. The method 200 can be 
implemented, for example, in the pushbutton user interface 
apparatus 100 described above with respect to FIG. 1. 

In step 201 , the occurrence of input to a pushbutton 
mechanism is identified. For example, depression of a 
pushbutton mechanism, application of force to a pushbutton 
mechanism or touching of a pushbutton mechanism can be 
identified in step 201 . In the pushbutton user interface 
apparatus 100 described above with respect to FIG. 1, 
step 201 can be performed by the input sensor (s) 102. In the 
particular embodiment of the invention described below which 
can be used, for example, to control a radio, step 201 can be 
performed by the force-sensitive resistors. 

As described elsewhere herein, a pushbutton user 
interface apparatus according to the invention can include 
multiple pushbutton mechanisms. When the method 200 is used 
with such a pushbutton user interface apparatus, step 201 can 
also include an identification of the particular pushbutton 
mechanism to which the user input has been applied. In such 
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case, in the pushbutton user interface apparatus 100 
described above with respect to FIG. 1 , step 201 can be 
performed by the input sensor (s) 102 and the processing 
device(s) 103. 

5 In step 202, the nature of the input to the pushbutton 

mechanism is determined. In the pushbutton user interface 
apparatus 100 described above with respect to FIG. 1 , 
step 202 can be performed by the processing device (s) 103. 
In the particular embodiment of the invention described below 
10 which can be used, for example, to control a radio, step 202 
can be performed by the microcontroller. 

The determination of the nature of the input to the 
pushbutton mechanism includes at least a determination of 
characteristic ( s ) of the input that enable the input to be 
15 identified as either a preview input or an activation input 
fg (see step 203, described below). For example, in step 202, a 

determination can be made of the amount of depression of, or 
force applied to, a pushbutton mechanism, the amount of 
depression or applied force determining whether the input is 
20 a preview input or an activation input. Or, for example, in 
the step 202, a determination can be made of which surface 
has been touched by the user, the surface being touched 
determining whether the input is a preview input or not. 

The method 200 can be implemented so that, in step 202, 
25 determination of other characteristic ( s ) of the input are 
also made. For example, the invention can be implemented so 
that the preview display varies in accordance with one or 
more characteristics of the preview input. For instance, the 
invention can be implemented so that the amount or degree of 
30 a preview display is increased as the preview input to the 
pushbutton mechanism is asserted to a greater degree (e.g., 
as the pushbutton mechanism is depressed an increasing amount 
or subjected to an increasing amount of force). In such 
case, step 202 of the method 200 can be implemented to 
35 determine characteristic ( s ) of the input which can be used to 
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ascertain the degree with which the preview input is 
asserted. 

In step 203, a determination is made as to whether the 

user input is a preview input or an activation input. In the 

5 pushbutton user interface apparatus 100 described above with 

respect to FIG. 1 , step 203 can be performed by the 

processing device(s) 103. In the particular embodiment of 

the invention described below which can be used, for example, 

to control a radio, step 203 can be performed by the 

10 computational device. 

As indicated above, the determination made in step 203 

is based on one or more characteristics of the user input as 

determined in step 202. For example, the invention can be 

*d implemented so that a preview input is determined to have 

•%Q 15 occurred when a pushbutton mechanism is depressed by less 

it than a specified amount or subjected to less than a specified 
CO 

vj amount of force, and an activation input is determined to 

lQ have occurred when the pushbutton mechanism is depressed by 

l~ greater than a specified amount or subjected to greater than 
p 20 a specified amount of force. 

y„- The method 200 can also be implemented so that, in 

ry 

vl step 203, if the input is determined to be a preview input, 

Q the degree with which the preview input is asserted is also 

determined. As discussed above, this determination can be 
25 used to affect the amount or degree of a preview display. 
In step 204, if, in step 203, the input has been 
determined to be a preview input, a preview display is 
produced, i.e., a display is produced of a preview of the 
effect associated with activating the pushbutton mechanism. 
30 In the pushbutton user interface apparatus 100 described 
above with respect to FIG. 1 , step 204 can be performed by 
the preview display (s) 104 and, depending upon the particular 
implementation of the pushbutton user interface 
apparatus 100, perhaps the processing device(s) 103. The 
35 preview display can be, for example, a visual display of text 
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identifying the functionality of the pushbutton mechanism or 
a spoken (audio) display of words identifying the pushbutton 
mechanism functionality. Other examples of preview displays 
that can be produced by a pushbutton user interface apparatus 
5 according to the invention are discussed elsewhere herein. 
As indicated above and discussed further below, in some 
embodiments of the invention, the amount or degree of the 
preview display can be variable. 

In step 205, if, in step 203, the input has been 
10 determined to be an activation input, the effect associated 
with activating the pushbutton mechanism is produced. In the 
pushbutton user interface apparatus 100 described above with 
respect to FIG. 1 , step 205 can be performed by the 
W activation apparatus 105 and, depending upon the particular 

15 implementation of the pushbutton user interface 

apparatus 100, perhaps the processing device(s) 103. 

CO 

lj Activation of a pushbutton mechanism can, for example, cause 

CO a particular radio station to be selected. Other examples of 

effects produced by activation of a pushbutton mechanism are 
Q 20 discussed elsewhere herein. 

Below, a particular embodiment of the invention is 
described in detail to illustrate how the invention can be 
implemented, and to facilitate and enhance understanding of 
the invention. However, it is to be understood that the 
25 invention encompasses implementation using a wide variety of 
other apparatus and, consistent with the principles of the 
invention, having a variety of other functionality. 

In one embodiment of a pushbutton user interface 
apparatus according to the invention, a force-sensitive 
30 resistor (FSR) or other input sensor (e.g., potentiometer, 
strain gauge) is mounted to the underside of each of multiple 
pushbutton caps which are, depending upon the particular 
implementation of the invention, compliantly or fixedly 
mounted on an appropriate support structure. The FSRs are 
35 operably connected to a microcontroller (e.g., the Microchip 
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PIC16C73 microcontroller) that operates in accordance with 
one or more computer programs that cause data values to be 
read by the microcontroller from each FSR as the FSR senses 
input to the corresponding pushbutton cap. Changes in 
5 resistance through the FSR (which correspond to changes in 
force applied to the pushbutton cap) are read by the 
microcontroller and resolved as numerical values on a scale 
from 0 to 255 (i.e., are represented as 8 bit data), thereby 
indicating how much force has been applied to the pushbutton 
10 (which, depending on the particular mechanical implementation 
of the pushbutton, can correspond to pressure applied to the 
pushbutton or displacement of the pushbutton). The 
microcontroller can transmit these values to a computational 
device. The computational device analyzes the values in 

ty 

15 accordance with the type of control which the pushbutton is 
being used to effect. For example, if the pushbuttons are 
rj being used to control radio (either conventional radio or 

CS Internet radio), as discussed in more detail below, the 

* ft 

numbers sent from the microcontroller can be interpreted as a 
20 volume of the channel corresponding to the activated 
^ pushbutton. A reading of 0 can be interpreted as no volume 

on the channel corresponding to the pushbutton, while a 
P reading of 255 can be interpreted as a channel selection. 

Values in between 0 and 255 lead to fade-in or fade-out of 
25 the volume of the corresponding channels, depending on 
whether the FSR measurement is increasing or decreasing. 

In an exemplary application of the invention, a 
pushbutton user interface according to the invention can be 
used to facilitate selection of a radio station (or other 
30 audio channel or recording from among a multiplicity of audio 
channels or recordings). For example, in one embodiment of 
such a pushbutton user interface, three pushbuttons are 
compliantly mounted on a plastic plate. Each pushbutton is 
preset so that activation of the pushbutton selects a 
35 specified radio channel: pushbutton 1 is used to select 
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radio channel 1 , pushbutton 2 is used to select radio 
channel 2, and pushbutton 3 is used to select radio 
channel 3. Depressing one of the pushbuttons causes the 
corresponding radio channel to fade in, the degree to which 
5 the channel is displayed (i.e., the volume at which the 
channel is displayed) being based on the amount of 
displacement of the pushbutton, e.g., as the pushbutton is 
depressed a greater amount, the corresponding channel is 
displayed more loudly. Fully depressing a pushbutton causes 
10 the corresponding channel to be selected. Thus, a user can 
have fully depressed pushbutton 1 and be listening solely to 
channel 1 . Running a finger lightly along pushbutton 2 will 
produce a mix of channels 1 and 2. Running a finger lightly 
Iq along pushbutton 3 will produce a mix of channels 1 and 3. 

%Q 15 If something new of interest is heard, a pushbutton can be 
ff , pushed firmly to engage the new channel, i.e., cause that 

vj channel to be displayed by itself. Such a pushbutton user 

*S interface according to the invention can be used, for 

5 example, as a remote controller for Internet radio. Such a 

C3 20 pushbutton user interface can also be used, for example, in a 
^ car stereo for switching radio stations or audio tracks. 
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In another exemplary application of the invention, a 
^ pushbutton user interface according to the invention can be 

used to facilitate viewing of visual content. The pushbutton 
25 user interface can implemented so that, as a current set of 
visual content (e.g., a particular television channel) is 
being displayed in a primary display window, pressing a 
pushbutton mechanism causes a secondary display window to 
appear (in particular, within the primary display window, 
30 i.e., a picture-in-picture display), the secondary display 
window displaying a new set of visual content (e.g., a 
different television channel) that corresponds to the 
pushbutton mechanism. The pushbutton user interface can be 
implemented so that pressing the pushbutton mechanism 
35 progressively harder causes the secondary display window to 
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become correspondingly bigger. Firmly pressing the 
pushbutton mechanism (e.g., depressing the pushbutton 
mechanism greater than a specified amount) causes the new set 
of visual content to be displayed in the primary display 
5 window. A pushbutton user interface according to the 
invention as described above enables the size of the 
secondary display window to be varied (and, depending upon 
the implementation, varied continuously), unlike user 
interface apparatus used to produce a conventional picture- 
10 in-picture visual display in which the secondary display 
window remains fixed in size. 

In yet another exemplary application of the invention, a 
pushbutton user interface according to the invention can be 
used to facilitate viewing of Web-enhanced television. 
%Q 15 Televisions are beginning to enable television programs to be 

3 , 

]Z supplemented by content (e.g., Web pages) obtained via the 

\j Internet. For example, a television can be constructed so 

that a link to a related Web site can be displayed while a 
television program is being displayed. A remote control can 
20 be implemented to Include a pushbutton user interface 

according to the invention so that providing an activation 
\j input to a pushbutton mechanism toggles the television 

^ display between a display of the television program alone and 

a display of a Web page corresponding to the link, either 
25 alone or together (e.g., overlaid on a part of the television 
program or displayed on half of the television screen while 
the television program is displayed on the other half) with 
the television program) . The pushbutton user interface can 
be further implemented so that providing a preview input to 
30 the pushbutton mechanism while the television program is 

displayed alone controls the display of a sliding screen for 
displaying part or all of the Web page. For example, the 
pushbutton user interface can be implemented so that lightly 
touching the pushbutton mechanism causes the screen to slide 
35 out a little, enabling a viewer to begin viewing a part of 
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the Web page. As the pushbutton mechanism is pressed 
progressively harder, the sliding screen gradually becomes 
larger- As the screen slides over the display of the 
television program, a viewer can begin viewing a part of the 
5 Web page so that the viewer can decide whether the viewer 
wants to continue sliding out the screen (i.e., depress the 
pushbutton further) to see more of the Web page (e.g., the 
viewer can determine whether the content of the Web page has 
changed since a last viewing of the Web page). A pushbutton 
10 user interface according to the invention as described above 
can enable Web content related to a television program to be 
monitored for updates with relatively little disruption to 
the observation of the television program being shown on the 
television (and with less disruption than would occur if the 
15 remote control only allowed toggling between a display of the 
television program alone and a display of the Web page 
alone ) . 

In still another exemplary application of the invention, 
a pushbutton user interface according to the invention can be 
C3 20 used to facilitate browsing of Web pages. Such a pushbutton 
user interface can be constructed, for example, as part of an 

ru 

%j input apparatus used with a computational device (e.g., 

P desktop or portable computer, personal digital assistant, 

Web-enhanced cell phone), such as a mouse, keyboard or 
25 keypad, or as part of a remote control used to control a Web- 
enhanced television, as described above. Providing an 
activation input to a pushbutton mechanism of the pushbutton 
user interface causes a highlighted link on a Web page to be 
selected. The pushbutton user interface can be implemented 
30 so that providing a preview input to the pushbutton mechanism 
causes information about a highlighted link to be displayed 
before selection of that link, such as the type, age or 
importance of the highlighted link. 
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In another exemplary application of the invention, a 
pushbutton user interface according to the invention can be 
implemented as part of an input apparatus used with a 
computer, such as a mouse or keyboard. A pushbutton 
5 mechanism of such a computer input apparatus can be used, for 
example, during interaction by a user with a desktop computer 
application, to activate a function provided in the desktop 
computer application (e.g., to display relevant information 
from a "help" facility of the application). In accordance 
10 with the invention, the pushbutton mechanism can be 
implemented so that a preview input to the pushbutton 
mechanism produces a display (e.g., audio, visual and/or 
haptic) of a description of a function that can be activated 
by the pushbutton mechanism. A pushbutton mechanism of such 



03 

v3 15a computer input apparatus can also be used to continuously 



control the degree of a function provided in a desktop 
computer application (e.g., when interacting with a painting 
CO program, to control the intensity of the color of a shape 

* while the shape is being drawn). Inputs to the pushbutton 

C9 20 mechanism that produce less than full activation of the 

function associated with the pushbutton (e.g., in a painting 
program, that produce a muted shade of a color) constitute a 
preview, in accordance with the invention, of the 
functionality associated with the pushbutton. 
25 In yet another exemplary application of the invention, a 

pushbutton user interface according to the invention can be 
placed on a door, or on or near a doorknob of a door, to 
relate information about the room on the other side through 
audio or tactile feedback. Such a pushbutton user interface 
30 according to the invention includes a single pushbutton. The 
pushbutton user interface is implemented so that a preview 
input to the pushbutton causes a preview display (e.g., an 
audio and/or a tactile display) to be produced that indicates 
information about the room (e.g., the temperature and/or 
35 humidity of the room, the type of room, the identity of one 
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or more objects in the room) and an activation input 
unlatches and/or opens the door to enable entry into the 
room. 

The invention has been described above as implemented in 
5 a pushbutton user interface. However, the principles of the 
invention can also be embodied in other user interface 
apparatus. In general, the principles of the invention can 
be implemented in any user interface apparatus in which input 
is provided via mechanical apparatus (and, in particular, 

10 mechanical switching apparatus). For example, in the 
application of the invention described above in which a 
pushbutton user interface according to the invention is 
placed on a door, or on or near a doorknob of a door, a user 
interface apparatus in accordance with the principles of the 

15 invention can also be implemented by constructing a doorknob 
such that rotation of the doorknob a first predetermined 
amount (e.g., rotation of the doorknob less than a specified 
amount) can constitute a preview input that produces a 
preview display as described above, and rotation of the 

20 doorknob a second predetermined amount (e.g., rotation of the 
doorknob greater than a specified amount) can constitute an 
activation input that opens or unlatches the door. As can be 
appreciated by those skilled in the art, a doorknob in a user 
input apparatus as described above can also be constructed so 

25 as to sense a preview input in other ways, using sensing 
apparatus and methods as described above with respect to 
implementation of a pushbutton user interface according to 
the invention. Similarly, any type of mechanical switching 
apparatus (e.g., a toggle switch or a rotary switch) can be 

30 constructed so that preview and activation inputs can be 
provided to the mechanical switching apparatus, thus 
producing a user input apparatus in accordance with the 
invention, using apparatus and methods as described above 
with respect to implementation of a pushbutton user interface 

35 according to the invention. For example, a mechanical 



switching apparatus can be constructed so that movement of 
the mechanical switching apparatus (e.g., toggle switch or 
rotary switch) a first predetermined amount can constitute a 
preview input that produces a preview display, and movement 
of the mechanical switching apparatus a second predetermined 
amount can constitute an activation input that produces the 
functionality associated with the mechanical switching 
apparatus . 

Various embodiments of the invention have been 
described. The descriptions are intended to be illustrative 
not limitative. Thus, it will be apparent to one skilled in 
the art that certain modifications may be made to the 
invention as described herein without departing from the 
scope of the claims set out below. 



